
############################## Experiment details ##############################

dataset: femnist
dataset_dir: ../data/femnist/
output_dir: output/fedprox/fedprox_femnist_mu1-2022-08-11 16:58:10.468244/
model: cnn
num_rounds: 100
eval_every: 10
ServerType: <class 'rayleaf.entities.server.Server'>
client_types: [(<class 'fedprox_cnn_exp.fedprox_cnn.<locals>.FedProxClient'>, 400)]
clients_per_round: 20
client_lr: 0.06
batch_size: 64
seed: 0
use_val_set: False
num_epochs: 10
gpus_per_client_cluster: 1
num_client_clusters: 4
save_model: False

############################## Simulation ##############################

Spawning 4 ClientClusters using cuda device (this may take a while)
400 total clients: 400 FedProxClients

>>> Training Accuracy: Round 0 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0222734 | 0.0263158 |                 0 |         0.0333333 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 0 <<<
+------------+----------+-------------------+-------------------+
|    average |   median |   10th percentile |   90th percentile |
|------------+----------+-------------------+-------------------|
| 0.00272308 |        0 |                 0 |                 0 |
+------------+----------+-------------------+-------------------+
--- Round 1 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 2 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 3 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 4 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 5 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 6 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 7 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 8 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 9 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 10 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 10 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.508728 | 0.512854 |           0.38871 |          0.613151 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 10 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
|  0.054322 | 0.0526316 |                 0 |               0.1 |
+-----------+-----------+-------------------+-------------------+
--- Round 11 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 12 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 13 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 14 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 15 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 16 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 17 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 18 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 19 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 20 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 20 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   2.85177 |  2.89189 |            2.1073 |           3.50128 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 20 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.320276 | 0.317073 |          0.187355 |          0.447368 |
+-----------+----------+-------------------+-------------------+
--- Round 21 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 22 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 23 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 24 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 25 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 26 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 27 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 28 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 29 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 30 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 30 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   4.75262 |  4.78087 |           3.48303 |           5.79591 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 30 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.532817 | 0.534959 |          0.361111 |          0.685714 |
+-----------+----------+-------------------+-------------------+
--- Round 31 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 32 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 33 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 34 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 35 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 36 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 37 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 38 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 39 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 40 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 40 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   5.48862 |  5.58974 |           4.24245 |           6.42145 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 40 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   0.61814 | 0.630604 |          0.444186 |          0.769231 |
+-----------+----------+-------------------+-------------------+
--- Round 41 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 42 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 43 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 44 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 45 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 46 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 47 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 48 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 49 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 50 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 50 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   6.09203 |  6.20294 |           4.74833 |            7.0716 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 50 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.683005 |  0.69697 |               0.5 |          0.837272 |
+-----------+----------+-------------------+-------------------+
--- Round 51 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 52 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 53 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 54 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 55 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 56 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 57 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 58 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 59 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 60 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 60 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   6.40714 |  6.52951 |           5.13593 |           7.30226 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 60 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.719802 | 0.733333 |           0.53125 |           0.86053 |
+-----------+----------+-------------------+-------------------+
--- Round 61 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 62 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 63 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 64 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 65 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 66 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 67 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 68 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 69 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 70 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 70 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   6.64209 |  6.75717 |           5.37586 |           7.55882 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 70 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.744449 | 0.756098 |          0.571042 |          0.878123 |
+-----------+----------+-------------------+-------------------+
--- Round 71 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 72 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 73 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 74 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 75 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 76 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 77 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 78 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 79 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 80 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 80 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   6.79423 |  6.92683 |           5.61272 |            7.6764 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 80 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.762114 | 0.772078 |           0.59375 |          0.888889 |
+-----------+----------+-------------------+-------------------+
--- Round 81 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 82 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 83 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 84 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 85 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 86 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 87 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 88 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 89 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 90 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 90 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   6.90993 |  7.02703 |           5.78623 |           7.75227 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 90 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   0.77147 | 0.777778 |          0.618908 |               0.9 |
+-----------+----------+-------------------+-------------------+
--- Round 91 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 92 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 93 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 94 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 95 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 96 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 97 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 98 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 99 of 100: Training 20 clients: 20 FedProxClients ---
--- Round 100 of 100: Training 20 clients: 20 FedProxClients ---
>>> Training Accuracy: Round 100 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   7.00209 |  7.11616 |           5.90784 |           7.82368 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 100 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.781246 | 0.789474 |           0.62379 |          0.902518 |
+-----------+----------+-------------------+-------------------+

############################## Post-Simulation ##############################

Total Experiment time: 0:13:59.131439
